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Introduction 


Overview 

The ear recognition system takes specific images of human ears as input 
and provides individual identification based on a personal database. The 
input images will be rescaled in Matlab and transformed into grayscale 
matrices. We implemented PCA (Principle Component Analysis) on the 
stored data in order to recognize specific patterns of ears. 


Motivation 

Biometrics, the science of human physiological or behavorial 
characteristics, has been a great interest for a simplified identification 
techonology. However, there are many drawbacks of current biometrical 
solutions such as iris recognitions, fingerprint recognition and voice 
recognition. We would like to introduce a new biometrical technique that 
can overcome these drawbacks or assist some of them to be more accurate. 
As anew branch of biometrics, ear recognition offers a convenient 
individual identification compared to other ways such as fingerprint 
recognition, iris recognition, etc. It has unique advantages and great 
potential over other biometric methods for being a secure and accurate 
detecting procedure. It also has a good balance between technical 
complexity and robustness. 


Method Major drawback 

Iris requires expensive camera, while ear 
recognition only needs normal camera. 

Fingerprint requires the subject's cooperation, also 
the process can be unhygienic. Ear 
recognition does not have these problems 


Face Human face changes considerably as 
people grow up. Even make-up and 
expressions will reduce the reliability of 
face recognition. But ears remain the 
same size always. 

Voice Human voice can be mimicked or 
recorded. Also people having throat 
illnesses will have problems with the 
system. However ears cannot be 
replicated easily. 


Implementation 


System Schematics 
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Enrollment Process: Each sample takes several photographs of the same ear. 
Standarize the size of the photos, change them to grayscale, and get the 
mean image. Store the image to our database. Recognizing Process: Collect 
image Pre-processing Standarize the size of the input photo. Change it to 
grayscale. Feature extraction PCA processing. Compare with the image in 


our database. 
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From the external anatomy figure above, we can see: 

external ear has enough details and complexities to help us recognize a 
particular ear. Based on statistics and researches, ears are unique for each 
human individual.. 


Principle Component Analysis 


Description 
Principal component analysis (PCA) is a statistical procedure that uses 
orthogonal transformation to convert a set of observations of possibly 
correlated variables into a set of values of linearly uncorrelated variables 
called principal components. 

1.Enrollment: 

Step 1 Reshape 

The training set is composed by several samples (200 for 
instance ). Each samples has size M*N and all gray-scaled. 


Xi is a reshaped column matrix with dimension MN. 
T 
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Step 3 calculate the difference with mean 
d, =x, —V,i=1,2,...,200 


Step 4 build covariance matrix 
i 1 


C= Waid’ =—-44 Atha 
200 on rt 200 ( 1 at baa) 

The size of covariance matrix is MN*MN 

Step 5 


Get the eigon vector and eigen value of the covariance matrix and 
build a eigen ear space 


Step 6 
Project every difference vector between training ear and mean ear 
toeigon ear space Q. = w'd.(i=1,2.....200) 


The size of covariance matrix is MN*MN 


2 Recognizing 
Step 1 This time project difference vector between testing ear and 


mean ear onto eigon ear space. Q! = yw! (IT _ Y) 

Step 2 Calculate the erlur distance &, between Q'and the ears. 
é;' =|}, -O" || (i =1,2,...,.200) 

Step 3 

Calculate the distance between the original image and reconstructed 

“ome =|P-r,]| 1, =wOl +¥ 


Step 4 
Compare the € and &; with the threshold value, decide whether the 
image matches the samples in our database. 


Limit and Solution 


1.The result of our ear recognition is influenced considerably by the angle 
of camera and the angle of the light source. 


2.Now we need to cut the photo of ear to the standard size we want 
manually, which is time-consuming and inconvenient for use. 


solution to 1 

To solve this problem in the future, we need to build a large database with 
photos of ears taken from all possible angles and all possible angles for 
light source in each case. Thus, it will be a comprehensive database. But 
now we did not have much time to build such a large database. 


solution to 2 

We need to build an auto-detection system to find the image of ear from the 
original photo. This system should detect the position of person in the photo 
and then detect the head, and then the ear. After all these detections, this 
system will cut the photo to get the standard image for further recognition. 


Future improvement 

(1)We can also apply PCA to face recognition or other recognitions, making 
a recognition system with both ear and other sort of recognitions. (2)We can 
build an auto-detection system which can find the ear automatically in the 
future.(3)Improve our algorithm or build a larger database to reduce the 
effect of light and hair, making our program more robust. 


Experiment results 


Results 

When we need to do recognizing. First, we standarize pictures in database 
and get the mean image. Then we calculate the difference between each 
image and the mean image. After this, we build covariance matrix from that 
and get eigen value and vector from the covariance matrix and build an 
eigen ear space. Then we project every difference vector between training 
ear and mean ear on to eigen ear space to get the eigen ear. 


Original Image Standarized Image 
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Test result with our program 


this is Gino 
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Codes and Library 
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% 

%We build a GUI for our ear recognition. This GUI has three 
%push buttons: choose a file, recognition and exit. 

%The first button let the user to choose an input file(.bmp) 

%to compare with existing library. The second button processes 
%the input file and gives the result that whether this ear is 

%in our library or not. The last buttons closes this program. 


WLWVVWVWUWVWVWVW%WVVWVVWVVWUWVHWWUWVWHWVW%WVVWVVWVVWV%V% 
WLHWVWVWVWUWVWWVW%WVVWVVWVWVWVWVWUWVWVV%U%%Y% 


%The following three functions are for generating an easy-to-use 
%GUI interface with three buttons. 


function varargout = Untitled(varargin) 


% UNTITLED MATLAB code for untitled.fig 

% UNTITLED, by itself, creates anew UNTITLED or raises the existing 
% singleton*. 

% 


% H = UNTITLED returns the handle to anew UNTITLED or the handle 
to 


% the existing singleton*. 
% 
% UNTITLED('CALLBACK',hObject,eventData,handles,...) calls the local 


% function named CALLBACK in UNTITLED.M with the given input 
arguments. 


% 

% UNTITLED(Property’,'Value’,...) creates anew UNTITLED or raises the 
% existing singleton*. Starting from the left, property value pairs are 

% applied to the GUI before untitled_OpeningFcn gets called. An 

% unrecognized property name or invalid value makes property application 
% stop. All inputs are passed to untitled_OpeningFcn via varargin. 

% 


% *See GUI Options on GUIDE's Tools menu. Choose "GUI allows only 
one 


% instance to run (singleton)". 


% 

% See also: GUIDE, GUIDATA, GUIHANDLES 

% Edit the above text to modify the response to help untitled 
% Last Modified by GUIDE v2.5 04-Dec-2013 17:00:55 

% Begin initialization code - DO NOT EDIT 

gui_Singleton = 1; 

gui_State = struct(‘gui_Name', mfilename, ... 
‘gui_Singleton', gui_Singleton, ... 

‘gui_OpeningFcn', @untitled_OpeningF cn, ... 
‘gui_OutputFcn', @untitled_OutputFcn, ... 

‘gui_LayoutFcn'’, [], ... 

‘gui_Callback', []); 

if nargin && ischar(varargin{1 }) 

gui_State.gui_Callback = str2func(varargin{1}); 

end 

if nargout 

[varargout{1:nargout}] = gui_mainfcn(gui_State, varargin{:}); 
else 

gui_mainfcn(gui_State, varargin{:}); 


end 


% End initialization code - DO NOT EDIT 

% --- Executes just before untitled is made visible. 

function untitled_OpeningFcn(hObject, eventdata, handles, varargin) 
% This function has no output args, see OutputFcn. 

% hObject handle to figure 

% eventdata reserved - to be defined in a future version of MATLAB 
% handles structure with handles and user data (see GUIDATA) 

% varargin command line arguments to untitled (see VARARGIN) 

% Choose default command line output for untitled 

handles.output = hObject; 

% Update handles structure 

guidata(hObject, handles); 

% UIWAIT makes untitled wait for user response (see UIRESUME) 
% uiwait(handles.figure1); 

% --- Outputs from this function are returned to the command line. 
function varargout = untitled_OutputFcn(hObject, eventdata, handles) 
% varargout cell array for returning output args (see VARARGOUT); 
% hObject handle to figure 

% eventdata reserved - to be defined in a future version of MATLAB 


% handles structure with handles and user data (see GUIDATA) 


% Get default command line output from handles structure 
varargout{1} = handles.output; 

%The following three functions are about the functionalities of 
%the 3 buttons of our interface. 

% Button 1 let the user to choose the input file. 

%Then, it change the input file to gray picture for further 

Youse. 

% --- Executes on button press in pushbutton1. 

function pushbutton1_Callback(hObject, eventdata, handles) 

% hObject handle to pushbutton1 (see GCBO) 

% eventdata reserved - to be defined in a future version of MATLAB 
% handles structure with handles and user data (see GUIDATA) 
global im; 

%get the path of the file, chosen by user 

[filename,pathname ]=uigetfile({'.bmp'},'choose a file’); 
str=[pathname, filename]; 

Y%read it 

im=imread(str); 

%change this picture to gray and show it to user in specific 


%frame. 


im=rgb2gray(im); 

axes(handles.axes1); 

imshow(im); 

% 

% --- Executes on button press in pushbutton2. 

function pushbutton2_Callback(hObject, eventdata, handles) 

% hObject handle to pushbutton2 (see GCBO) 

% eventdata reserved - to be defined in a future version of MATLAB 
% handles structure with handles and user data (see GUIDATA) 
global im; 

%get pictures in our library, change them to gray and store 
%them to imgdata 

imgdata=[]; 

for i=1:2 

for j=1:5 

a=imread(strcat('C:\NewLib\P' ,num2str(i),'\',num2str(j),'.bmp')); 
%a=rgb2¢gray(a); 

%subplot(ceil(sqrt(5)),ceil(sqrt(5)),j) 

%imshow/(a) 


%if i==2 


% title(‘Training set','fontsize’,18) 

%end 

%drawnow; 

%standarize the size of each image. 
b=a(1:250*360); 

b=double(b); 

imgdata=[imgdata;b]; 

%imgdata is am*n matrix. Each row of it stores an image. 
end 

end 

%get the mean image of images in imgdata 
imgdata=imgdata’; 

imgmean=mean(imegdata,2); 

%get minus, a m*n matrix. Each row of it stores 
%(each image)-(mean image) 

for i=1:10 

minus(:,i)=imgdata(:,i)-imgmean; 

end 

Yoconve is am*m matrix 


%get coefficients from convex for later use. 


convex=minus'*minus; 
[coeff,latent,explained]=pcacov(convex’); 
%Yget 95% power 

i=1; 

proportion=0; 

while(proportion<95) 
proportion=proportion+explained(i); 
i=i+1; 

end 

p=i-1; 


i=1; 


%make a coordinate system for the traits of ears. 


while(i<=p&&latent(i)>0) 
base(:,i)=latent(i)\(-1/2)*minus*coeff(:,i); 
i=i+1; 

end 

reference=base'’*minus; 

%test and show 

a=im; 


b=a(1:90000); 


b=double(b); 

b=b'; 

object=base'*(b-imgmean); 
distance=10000; 

for k=1:10 
temp=norm(object-reference(:,k)); 
if(distance>temp) 

which=k; 

distance=temp; 

end 

end 

if (which==10) 

title(‘the person is not in the lib’); 
end 

num1=ceil(which/5); 
num2=mod(which,5); 
if(Mum2==0) 

num2=5; 

end 


I=imread(strcat('C:\NewLib\P',num2str(num1),'\',num2str(num2),'.bmp')); 


axes(handles.axes2); 

switch num1 

case 1 

imshow(l]); 

title(‘this is Gino’); 

case 2 

imshow(I); 

title(‘this is Mark '); 

end 

%button 3 just close the program. 

% --- Executes on button press in pushbutton3. 

function pushbutton3_Callback(hObject, eventdata, handles) 

% hObject handle to pushbutton3 (see GCBO) 

% eventdata reserved - to be defined in a future version of MATLAB 
% handles structure with handles and user data (see GUIDATA) 


close(gcf); 


